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(57) Abstract: A method is disclosed in this publication for modeling dif- 
ferent internal structures of a head, such as different parts of the brain, the 
method comprising the step of determining the location of the internal struc- 
tures, such as the different cerebral parts, of at least one first head (B) in a 
three-dimensional space by technical means, e.g., magnetic resonance imag- 
ing or computer-aided tomography. According to the invention, the external 
dimensions of at least one second head (A) are determined, and the location 
data of the internal structures of the first head (B) are scaled in a three-dimen- 
sional space to correlate with the external dimensions of the second head (A), 
whereby the location data of the internal structures of the second head (A) also 
become modeled without the need for anatomical images of the second head 
(A). 
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- Method for three-dimensional modeling of the skull and internal structures 



th ereof 



The invention relates to a method according to the preamble of claim 1 for three- 
5 dimensional modeling of the skull and internal structures thereof. 

This patent application describes a method suited for modifying a set of magnetic 
resonance images taken from the head (standard head) so that the external shape of 
the head determined from such a set of images can be transfonned to correlate with 
0 the contour of the head of another test person or patient. The present method is par- 
ticularly suited to the magnetic stimulation of the brain as well as to electro- 
encephalography and magnetoencephalography. 

In transcranial magnetic stimulation (TMS) of the brain, a coil excited with a strong 
5 current pulse of short duration is placed over the head. As a result, an electric current 
stimulating cerebral tissue is induced inside the skull. In order to focus the magnetic 
stimulation on a certain selected area of the brain, it is often necessary to resort to the 
magnetic resonance images taken from the test person's or patient's head. Herein, the 
location and orientation of the coil acting as the response-evoking means of magnetic 
o stimulation is determined in regard to the coordinates of the patient's head with the 
help of a suitable localizing system. Subsequently, the location of the coil can be 
mapped on the magnetic resonance images (MRI) of the patient, whereupon the 
system operator can readily focus the stimulation on a desired area. One such method 
is described in FI Pat. Appl. 20021416. 

5 

Respectively, the magnetic resonance images of the patient's head are utilized when 
there is a need for locating a functional cerebral part in the anatomy of the brain. 
Brain functions can be recorded and located using conventional methods such as 
electro- and magnetoencephalography (EEG and MEG). Both of these methods 
) typically use tens or even hundreds of measurement channels that sense electromag- 
netic fields evoked by brain activity at different points about the head or on the scalp. 
By knowing the exact locations of the measurement sensors relative to the head 
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coordinates, it becomes possible to identify brain functions and to visualize the 
anatomical structure of each point in the magnetic resonance images. 

Conventionally, the head anatomy of the patient or test person being examined is 
5 first recorded by taking anatomical magnetic resonance images or other type of 

images resolving anatomical structures. Next, at least three fixed marker points are 
selected on the head surface such that they can readily be identified on both the mag- 
netic resonance images and the surface of the head. Advantageously, the auditory 
meatuses and the nasion, for instance, are chosen to serve as marker points. As a 

10 result, a coordinate transformation can be formulated suitable for identification of a 
point in the magnetic resonance images corresponding to a certain point on the 
surface of the head. Thus, e.g., the location of a TMS coil in regard to anatomical 
structures can be ascertained or, alternatively, a stimulus-responsive point in the 
brain located with the help of MEG can be located in regard to anatomical structures. 

15 Various techniques are available for making a suitable coordinate transformation. 

Magnetic resonance images of the test person's head are required in the implementa- 
tion of this method. 

Using known methods, magnetic resonance images can be deformed so as to provide 
20 correlation with the respective computer-aided tomography images. The deformation 
method is called image fusion. In this process, both ones of the sets of images are 
analyzed to find a plurality of fixed marker points that are identifiable in both image 
sets. Subsequently, a deforming transformation can be carried out such that the 
corresponding points of the images to be matched become aligned with each other. 

25 

In the art are also known methods for warping magnetic resonance images taken by 
MRI techniques from a test person so that the nonideal properties of magnetic 
resonance imaging such as the nonlinearity of gradient fields, are corrected. In these 
methods, correction factors are measured or computed and thereupon the images are 
30 respectively deformed. In EP patent publication 1 176 558 is further described a 
method for external patient contouring with the help of a suitable surface imaging 
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system, whereupon the information thus gathered is used to deform the patient's MRI 
images for planning a radiotherapy treatment. 

Further methods known in the art are based on deforming by dilatation and contrac- 
5 tion warping techniques a set of MM images taken from different persons so that 
first the same fixed anatomical or functional marker points are identified in the 
images of each one of test persons individually. Thereupon a mathematical mapping 
is computed individually for each test person such that the test person's MRI images 
are transformed in a fashion allowing the selected marker points of the deformed 

10 image sets to have the same coordinates for all the test persons. One such method is 
the so-called Talairach cerebral imaging system (J. Talairach and P. Tournoux, Co- 
planar Stereotaxic Atlas of the Human Brain, New York, Thieme Medical 
Publishers, Inc., 1988). The goal of this system is to deform the MRI images of 
different persons so that the MRI images of the different persons' brains can be 

1 5 compared with each other. 

The above-described methods have in common that all of them need anatomical 
images of the test person's head. 

20 Still further in the art are known methods in which the head contour is determined by 
means of an imaging system and the thus mapped surface of the head is formed into 
a triangulated grid that serves as a mathematical model in the computation of electro- 
magnetic fields associated with the use of MEG, TMS or EEG. Attempts have also 
been made to determine by statistical methods from the head contour such a triangu- 

25 lated grid that further represents the brain contour of the same test person. In this 
kind of method, magnetic resonance images are utilized to generate a statistical 
model representing correlation between the surfaces of the head contour and the 
brain contour. One such method is disclosed in publication D. van't Ent, J. C. de 
Munck, and Amanda L. Kaas, A Fast Method to Derive Realistic BEM Models for 

30 E/MEG Source Reconstruction, IEEE Trans. Biomed. Eng. (2001), BME 

48(12): 1434-1443. This method, however, is not used for processing MR images. 
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A problem hampering the use of the prior-art methods and apparatuses is that the 
analysis or visualization of data represented by the MRI images is possible only by 
taking the magnetic resonance images separately from each patient's or test person's 
head Due to the high cost of magnetic resonance images of the head, also the overall 
5 cost of TMS, EEG and MEG examinations become high. Resultingly, the availability 
of TMS, MEG and EEG is limited. 

If magnetic resonance images taken from the head of the person being examined are 
not available or the use thereof is not desirable, it is difficult to visualize even 
10 coarsely the area of the skull hiding a given brain region of interest. The basic reason 
hereto is that the head contour and size vary largely from person to person. 

In a typical TMS examination, for instance, it may be desirable to focus the magnetic 
stimulus on the prefrontal region of the left hemisphere by placing a figure-of-eight 

15 stimulation coil at the desired area of the head. However, it is difficult to select the 
proper area on the head if no anatomical images of the interior structures of the head 
are available. Respectively in a typical MEG and EEG recording session a response 
is discovered relating to a certain task, which can be located inside the head in 
relation to marker points situated external to the head. Lacking access to anatomical 

20 images illustrating the interior structures of the head, however, it is difficult to tell 
the anatomical part of the brain that coincides with the identified point of response. 

In another typical MEG or EEG examination, the task may be to identify brain 
activity at two different regions of the brain as a response to, e.g., a task involving 

25 motor skills. In this exemplary case, the first region can be positively identified based 
on such variables, among others, as the characteristic waveform of the response to 
represent the function of the motor cortex, while the anatomical locus of the other 
component of the response cannot be located without resorting to magnetic reso- 
nance imaging or other techniques such as computer-aided tomography suited for 

30 resolving anatomical structures. 
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It is an object of the present invention to provide an entirely novel kind of method 
capable of overcoming the problems of the above-described prior art. 

Accordingly, the invention strives to achieve a fully new approach to the approxi- 
5 mate localization of the major brain regions in a test person's head without the need 
for magnetic resonance imaging. The method is particularly useful in the focusing of 
magnetic stimulation and in the interpretation and visualization of results obtained b> 
means of magnetic stimulation, EEG and MEG. This facility can be employed, e.g., 
for making screening measurements for large groups of patients without the need for 
1 o taking costly MRI images from each patient individually. 

The goal of the invention is attained by virtue of modeling the coordinates of the test 
person's head as to its different internal anatomical regions and particularly its differ- 
ent brain regions on the basis of the test person's head contour and, additionally, on 
15 the basis of the different internal anatomical regions, particularly its different brain 
regions, actually recorded from the head of another test person. 

More specifically, the method according to the invention is characterized by what is 
stated in the characterizing part of claim L 

20 

The invention offers significant benefits. 

One major advantage is that the patient need not be subjected to magnetic resonance 
imaging to identify the internal anatomy of the patient's head for proper focusing of 
25 magnetic stimulation or analysis of MEG and EEG recordings. 

Another advantage is that the method allows the stimulation responses of different 
patients to be compared with each other in the coordinate system of a "standard 
head". 

30 

A third advantage is that a deforming image transform can be carried out or refined 
using functional marker points identified in the interior volume of the brain. 
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A still further advantage is that the method makes it possible to readily indicate with- 
out anatomical imaging the coarse coordinates of a point on the head surface under 
which a given anatomical brain region is located Furthermore a coarse location of a 
5 given brain anatomical region under a selected point on the head surface is possible 
without the need for magnetic resonance imaging. 

In the following the invention will be examined with the help of exemplary embodi- 
ments and by making reference to the appended drawing in which 

10 

FIG. 1 is a schematic illustration showing the use of a method according to the 
invention in a single plane. 

Referring to FIG. 1, the upper diagram shows a single plane of accurate magnetic 
15 resonance images taken from the head of a test person B. Test person A is measured 
only for the external dimensions of the head in order to draw the sectional plane A 
shown in the middle diagram. According to the invention, the coordinate data of 
diagram B are dilated and/or contracted (that is, scaled) so as to fit the data within the 
confines of sectional plane A, whereby the diagram of sectional plane A is 
20 transformed into a modeled sectional diagram A'.In the exemplary case, it has been 
necessary to dilate the diagram shape of sectional plane B in the vertical direction 
and to contract in the horizontal direction. 

. The above-described procedure is applied entirely identically also in the height direc- 
25 tion, whereby three-dimensional modeling is attained. 

Accordingly, the invention is based on using a method wherein the head contour of 
the person (first person A) being examined is determined by measuring the coordi- 
nates of selected marker points on the scalp with the help of a localization system. 
30 Advantageously, the number of measured marker points is some tens and they are 
located at different sides of the head. The greater the number of measured marker 
points the better is the result of the deformation process. Already five marker points 



WO 2004/035135 



PCT/FI2003/000772 



7 

on the head (forehead, left side, right side occipital protuberance and parietal top) 
give relatively accurate results. Next, the head contour of some other person (person 
B) is determined from magnetic resonance images taken earlier from this person's 
head. The images of person B are deformed (scaled) computationally using transla- 

5 tion, rotation and linear and/or nonlinear deformation so as to make the shape of the 
head images correlate with the contour of the person's scalp, whereby a deforming 
linear or nonlinear transformation between both shapes takes place. The head images 
taken from person B may also be called a standard head. In the method the trans- 
formation is applied volumetrically to the entire sets of magnetic resonance images, 

10 that is, also to coordinates located in the interior volume of the head. Herein the loca- 
tion and shape of the anatomical structures may become distorted. It is also possible 
to use a plurality of standard heads (e.g., separately for adults and children), whereby 
a standard head of closest fit can be individually selected for each patient. Also the 
racial differences between head contours can be taken into account by maintaining a 

15 selection of different standard heads. Advantageously, the standard head is computed 
using a set of MRI images having a good resolution, e.g., 256x256 pixels in each 
sectional plane. 

Image deformation (scaling) can be carried out, for instance, in the following 
20 manner. First, the magnetic resonance images of the standard head, that is, those 
taken from the head of person B, covering an entire sectional plane of the head are 
segmented by determining the coordinates of selected marker points on the skull 
surface. Next, selected points of the scalp of person A being examined are deter- 
mined in the earlier described fashion using a localizing system. Thereupon a suit- 
25 able linear or nonlinear deformation algorithm is carried out such that the magnetic 
resonance images of person B are deformed maximally well to correlate with the 
head shape of person A. The deformation transform may also be incomplete, 
whereby the shapes of the two heads are not aggressively deformed to full 
correlation. Suitable deformation algorithms are extensively described in the 
30 literature of the art. The magnetic resonance images can be represented digitally in 
any known graphic format such as pixel or vector graphics. 
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One exemplary deformation technique comprises determining from the magnetic 
resonance images of person B the location of, e.g., five marker points (the left and 
right auditory meatuses, the nasal bend also called the nasion, the occipital protube- 
rance also called the inion arid the parietal top). The respective marker points are 
5 determined with the help of localizing system from the head surface of the person 
being examined. First, the marker points are registered with each other by way of 
carrying out a transformation that by translation and rotation makes the respective 
marker points of the heads of persons A and B to converge with each other. 
Subsequently, a linear scaling algorithm can be applied to the magnetic resonance 

10 images of test person B can be subjected to linear scaling such that the respective 
marker points unite with each other. As a result, a deforming transform takes place 
capable of making the head shape identified from the magnetic resonance images of 
person B to correlate coarsely with the head shape of person A. When necessary, the 
procedure may be similarly extended to correlation of a larger number of marker 

15 points. 

One possible deformation procedure comprises the use of an algorithm described in 
publication J. L6tj5nen, et al.: Model Extraction from Magnetic Resonance Volume 
Data Using the Deformable Pyramid, Medical Image Analysis, Vol. 3, No. 4, pp. 

20 387-406, 1999). First, the magnetic resonance images of person B are processed to 
determine marker points on the head surface, e.g., by image thresholding. The head 
contour of person A is determined at N points using a localizing system. Both sets of 
points are registered with each other by way of performing translation and rotation 
operations such that make the sets of points to converge with each other maximally 

25 well. When using optimally selected translation and rotation operators, one possible 
strategy is, for instance, to aim at a minimum sum of squares of differences between 
local radii of curvature on the correlating surfaces. Next, the magnetic resonance 
images are divided into a cubic grid of 3x3x3 voxels. An energy function E is 
defined that may be, e.g., the sum of distances from the points of image set A to the 

30 respective next closest point of image set B. Also for each elementary cube of the 

grid is written a deformation function f(x,y,z) that typically is a spline or polynomial 
function (such as Bernstein polynomials) and thus defines the amount of translation 
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at other points of the cubic grid caused by a shift of one corner point of the grid. 
Generally, the amount of grid deformation becomes the smaller the larger the 
distance of the grid point from the corner point. The deformation function may be 
linear or nonlinear. Next, the locations of the grid points are translated so as to mini- 
5 mize energy function E. As a result, the elementary cubes of the initially perfect 

cubic grid are dilated or contracted and thus deformed. The deformation function f is 
applied to each elementary cube. After the minimization of energy function E, the 
surfaces of the heads correlate with each other. In practice, also certain boundary 
conditions must be defined for the cubic grid. For instance, it may be advantageous 
10 to confine the dilation of the individual elementary cubes so that the dilation of all 

elementary cubes is uniform. Such a suitable boundary condition may be implement- 
ed in energy function E. 

In another embodiment of the invention, also functional marker points of the brain 

1 5 may be utilized. Herein, the localization of the motor cortex area of a person being 
examined but not having MR images of the head available can be carried out by 
magnetic stimulation or, alternatively, using electroencephalography or magneto- 
encephalography or infrared tomography. Localization is performed relative to 
external marker points of the head (e.g., ears and nose). Similar localization is 

20 performed in beforehand for another person (person B serving as a standard head) for 
whom the magnetic resonance images of the head are available. The localization of 
the motor cortex of person B is performed from the MR images. The set of magnetic 
resonance images is warped so as to make the locations of the motor cortex of the 
patient and the second person to correlate. Additionally, the MR images of person B 

25 are deformed so as to bring them into at least partial correlation with the head shape 
of the person being examined. A similar procedure is also applicable to the 
utilization of multiple different functional marker points such as the motor or visual 
cortical areas of both hemispheres. When so desired, it is also possible to utilize 
herein the location of such a functional marker point that has been determined by 

30 statistical methods for a plurality of persons. 
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An example of the use of functional marker points in image def onnation is represent- 
ed by IMS. With the help of this method, the location of the motor cortex can be 
readily determined by moving the stimulation coil over the head until the strongest 
muscle response (recorded by EMG) is detected in the hand muscles of the opposite 
5 side of the body. The same localization may be carried out for both hemispheres. 
Using suitable weights in the deformation procedure, the motor cortex locations of 
the person being examined and person B are made to coincide with each other. 

An essential feature of the present method is that the locations of the magnetic stim- 
10 ulation coil, the EEG electrodes or the MEG sensors are measured relative to the test 
person's head coordinates using a localization system. Herein, on the person's head 
is mounted a position sensor whose location can be determined with the help of a 
localization system. The localization system is used for determining at least three 
marker points of the head (such that may also be identified in the MRI images), 
15 whereupon the deformation of the image coordinates can be performed, The localiza- 
tion system used in the invention can be based, e.g., on infrared radiation or electro- 
magnetic fields. This kind of equipment is commercially marketed, e.g., by a 
Canadian company Northern Digital Inc., for instance. 

20 In the context of the present application, scaling refers to a data processing method in 
which data generally representing an image is transformed into another form by 
linear or nonlinear procedures of dilatation/contraction warping of the image. An 
alternative term for this operation is deformation. 
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What is claimed is: 

1. A method for modeling different internal structures of a head, such as different 
parts of the brain, in order to focus magnetic stimulation and/or visualize the results 

5 of magnetic stimulation, MEG or EEG, the method comprising the step of 

- determining the location of the internal structures, such as the different 
cerebral parts, of at least one first head (B) in a three-dimensional space by 
technical means, e.g., magnetic resonance imaging or computer-aided 
tomography, 

10 characterized in that 

- the external dimensions of at least one second head (A) are determined, and 

- the location data of said internal structures of said first head (B) are scaled 
in a three-dimensional space to correlate with said external dimensions of 
said second head (A), whereby the location data of the internal structures of 

1 5 said second head (A) also become modeled without the need for anatomical 

images of said second head (A). 

2. The method of claim 1, characterized in that the method is utilized in the focus- 
ing of magnetic stimulation and/or visualization of results obtained by magnetic 

20 stimulation, MEG or EEG 

3. The method of any one of foregoing claims, characterized in that said location 
data is displayed in an image format and the scaling thereof is implemented by 
mutual moving of individual pixels. 

25 

4. The method of any one of foregoing claims, characterized in that the response 
recorded by MEG or EEG or, alternatively, the effective stimulating field of TMS is 
localized in relation to anatomical marker points determined on the head surface. 

30 5. The method of any one of foregoing claims, characterized in that the measure- 
ment system of the external head dimensions is based on the use of infrared light, 
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electromagnetic fields, laser light or a pointer equipped with electrical position 
sensor means. 

6. The method of any one of foregoing claims, characterized in that the image 

5 scaling algorithm includes an optional scaling facility that in the scaled set of super- 
posed images adjusts the distance from the cortex to the scalp to a value typical for 
the person being examined in a cohort of persons of the same age. 

7. The method of any one of foregoing claims, characterized in that, in addition to 
10 head surface marker points or in lieu thereof, the deformation operation is carried out 

utilizing the location data of such functional points of the brain that, without using 
magnetic resonance imaging, can instead be localized with the help of magnetic 
stimulation, MEG or EEG as functional points of the brain. 

15 8. The method of any one of foregoing claims, characterized in that the image 

deformation is performed using a minimizing algorithm that minimizes the mutual 
distances between the respective points of the deformed image of head (A) and the 
points measured on the surface of a second person's head (B). 

20 9. The method of any one of foregoing claims, characterized in that the computa- 
tion results of the minimization algorithm are accepted even when the mutual 
distances between respective image points are not reduced to zero. 

10. The method of any one of foregoing claims, characterized in that the method is 
25 utilized for visualizing in a layman fashion the results of TMS, EEG or MEG 

examinations performed on a patient having no magnetic resonance images of his/her 
head available. 

11. The method of any one of foregoing claims, characterized in that the method is 
30 utilized in the display of results in a single set of MR images obtained from measure- 
ments performed on a plurality of test persons. 
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12. The method of any one of foregoing claims, characterized in that the standard 
head used in the method is selected from a library of plural magnetic resonance 
images taken from a plurality of persons representing heads of different types and 
shapes. 

13. The method of any one of foregoing claims, characterized in that linear scaling 
is used in the method. 



14. The method of any one of foregoing claims, characterized in that nonlinear 
1 o scaling is used in the method. 
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